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The education profession is presently confronted with an 
unparallulcd demand to account for stiident achiovcnient and 
teadicr pcrforniancc, Systenis and inanagonient moddH froni 
spLiao age technology are being apijlicd directly in tlie formula- 
tion and evaluation of roading and language curricula. Tho 
"scientific management'' ofEcrcd by a range of publishers through 
instructional systems^ managenient systems^ and performance- 
based contracts creates at least the iniprassion that pedagogy is 
rapidly being ti^insformed into educational technology, Many 
state legislatures have conrpleted, or are hi the process of com- 
pleting, legislation which will '^insure" that adequate evaluation 
of the educational product will take place. Our * accountability 
era" of the 1070s is in many ways similar to education s ^^cfTicicncy 
mix' of die early 1000s, Teachers and administrntors are intensely 
concerned about key issues related to instructional objectives, 
^ testing, cost accounting, and about the way in which these con- 
' cepts will afFect instruction and more in.iportantly the learner. 

From the time of the creation of the Coninilssion. on Reading 
by the National Council of Teachers of English in 1970, its incni- 
bership lias been intensely concerned about issues related to 
accountability and reading instruction. This is reflected in Coni- 
mission-sponsored meetings at the November, 1971 Las Vegas 
NCTE Com^ention and the May, 1972 Detroit IRA Convention* 
The discussions tliat follow derivo from tliese meetings and pro- 
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vido a busts of undarstanding \vhilu raiding critical issuoH related 
to aucountahility and rouding iiistniction. 

Thv initiid prascntution by Jamvs LafFey develops a brief 
historieal analysiH of educational acGQuntaliility follQwed by a 
diseiKision of die alternative^^ and the crucial :^oblcms which niiist 
be undei'Htond in doveloping an accountability system. Threo 
isHuCH introduced in LafFcy s paper— behavioral objectives, test- 
ing, and perfonnance contracting— are discussed in depth by 
Hieliard Ufjdges, Kennedi Goodman, and Mary Galvan, 

Rielnird Hodges identifles the nature and sources of be- 
havioral olijectives as he examines underlying aHSumptions related 
to goals of instnietion, nicasurenient, and die content and mcth- 
fidology of learning. He dien considers the eonsequcnces that 
derive logically from the assuniptions. His eritical analysis of tlie 
fornnilntion of objectives provides important cautions and guide- 
lines for reading instruction. 

The penetrating paper on testing by KenneUi Goodnian con- 
eurns reading tests, Htutistical fallacies in reading tests, design 
problems in constnicting reading tests, ajid ahnses of tests. Good- 
nian poses eritica] questions teHt-makers must eonsider if their 
instruments are to becoma valid and niovo beyond sophisticated 
test theory. Finally, he speculates on die nature of future reading 
tests, giving special consideration to the es'aluation of reading 
achievement "as it really occurs in natural language/' 

Mary Galvan's discussion provides au overview of recent 
deN;e]Qpments in peiformarec contracting, ranging froni concerns 
with the early TcNarkana project to insightH deri\^ed from her 
perforniancc-contraeting woik in the Texas Education Agency. 
Advantages as well as severe limitations and disadvantages of 
performance contracting are discussed. The eonsideratioii given 
to legal questions deser\^es careful attention. Gals'an concludes 
her discussion by Identifying needs and rccomniendations useful 
iri developing currieuluni-oriented guidelines for schools niter- 
ested in performance contracting, 

The brief concluding discussion by Harold Herber identifles 
a range of critical issues based on tllo preceding discussions. Ah 
thougli the intent of these summary issues relates to reading in- 
sfa;uetion, the reader will quickly recogni^se their general applica- 
bility. Herbers call for a re-exami nation of our priorities In light 



I 



of tlic prvBH of accountability dcNurvPs careful tliouglit an ^ ^n^ 
sidemtion hy all mc^mbm nf tlic prufcHsion, 

The intent of 1]kj Cumniission in davcloping lliin disLUSsifJu. 
was to provido insiglil; into critical kmoH rclrtted to accountuhility 
and reading instruction. HopcrulK% these papers will prove to 
1)0 of cleciHionMnuking \^alua m edneaiur^ at all levels carefully 
examine the vast array of thcnretical and applied prohlcMiiH that 
must be considered in an "accountaliility era/' 

Robert B, Huddclh Director 

Commission on Reading 

National Council of Teaehers of English 
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Mcounc^iiiiwV- 

A BRIEF HISTORY AND ANALYSIS 



All aiticle by Stanley Elam, *The Ago of Accountability 
Dawns in Texarkana/' leaves tlie reader with the distinct im- 
pressions that (1) accountability is a commonly understood con- 
cept and (2) it is a relatively new edueatlonal concept ^ Both 
ideas are en^oneous. 

The purpose of this paper is to trace the roots of modern 
concepts of uccountability to an earlier period in educational his- 
tory hnown as the "*effleiency era/" to discuss the origins of more 
recent ideas of accountability^ and to analyze some problems 
relevant to l oth versions of accountability. 

Early Origins of Accountability 

The "efficiency era" in education began around 1900 and 
ended about 1925. It %vas an age when scientiflc management 
offered itself as the panacea for solving all the problems of tlie 
schools, Even though scientific management failed in tliis en= 
deavor^ as many educators would have predicted, the years and 
experiences did point out one of the hard reaUties educators have 
to face. Schools exist in a cultural context, and often the cultural 
context dictates how the schools operate, 

^ Stanlej^ ElaiHi "The Age of Accountability Dawns in Texarlcana^*' Phi 
Delta Kappan SI (June 1970), 509-14. 
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The cultuml contuxt of tliu "ufriciancy era" was that of hmi- 
nvsH and inchiHtiy. RaxMiiond E, Ciillalian slixU^s that ''the rise at 
buHine^s and industry to a po^ttHni of prestige and iiifluunce 
[resulted in] Aniericas subsequent saturation with bushiuHH and 
indnstrial vahies and practices/'^ And as business and industry h 
poHcics and leaders began to exert tlieniselvcs as a niajur cultural 
inflnenee, it bccanie apparent diat educator!^ and sehool adniinis- 
Irators were in oxtrcniply vuhieraUlo positions, WiUnn this cub 
tural setting, the "efiieiency expert" entorcd the arena to save 
the schools froni their own incnicicncics. 

In 1911, Fredorick Taylor, an industrlLd engineer; began to 
UApound a systeui of scientific luanagenicnt. In fuct, because of 
Auiericas concern for efRcioncyj Taylor became ])rc)niinent na- 
tionally, This in turn led Taylor to pronounce that his prinelples 
had unwemd appliaahilUy; hv ha said '1iis principles could 1)0 
upplied with equal force to all social activitjtist to the manage^ 
in.cnt of honies: the uianagcment of oin^ farms; tlie nianagcnicnt 
of the business of our tradesmen/''^ 

Due to Taylor's influcnee, and the influence of others like 
him, the remaining years of the second deeade of the twentieth 
century, were devoted to criticising die schools for dieir ineffl- 
eiencies and asking why die schools of America were not as 
effleient as buj^ines^^ and industrial orgnnimtion^. One layman 
clarified the issuo by stating that ''if they [the schools] were as 
efHcient as business and industry, then they could provide the 
public with I'esults diat could readily be seen and jncasured/'^ 
Tlie response by educators to tliese critical observations led to 
the exploratory developuient of many standurdised evaluation 
forms and tests. 

Possibly one of the most important single events during this 
lime was the hiring of a school administrator named Frank 
Spaulding. Spaulding began his career as superintendent of 
schools in Newton, Massachusetts— a "burial graund for superin- 
tendents " The school board in Newton was notorious for its 
concern widi spending. In otlier words, the dollar wm the eduea- 



-RLiyiiujnd Qilhilmn, Ednnailon and iliti Ctdt of Effiaimtcy (CliienMCJ- 
UniverHity of Chicngu PreNs, 1962), p. B, 
^ Ibid,, p. 43. 
^ IbuL, p. ^8. 
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tionai crituron in Newton. And it is pai^iblu to suggest that 
with tliu liiring of Frank SpuulcHng by tlie Newton schools, oduca- 
tional accountability had its start 

For the school year 1011-1912, Spaiilding initiated a co.st 
nccoiniting system in tlic Nuwton scliuols, llu reported to u grunp 
of seliool adniinistrators and cliscuHsed not only per pupil experidi- 
turu for the school year but also per unit costs of speelfic *subjuc;ls 
and percentage of the total budgets invested in spccifie subjcet 
ureas, In fact, Im analysis led Callahan to the following con- 
clusions: 

Spaulding's conception of scientific nianagcment obviously 
nmouritucl to an aunlysis of tlie i)ndget By i\ .slucly of local con- 
mleratiom he meant a shidy of tlie ^T-pupil costs and pupil- 
recilntion co^Ls. His seieniifio dciermiualion. of adiicaliorml valuu 
turned out lo be a dutcnninatiou of dollar vahic, Ilis docisions 
f^n wlint should be taught were inade not on educational, mtf 
on financial grounds. Thin was not tlio first tinia nor was it to 
be the liish But tlii^ oeeasiou wns parllcularly unfortunnte be- 
euuse it was presented to leadfiig administrators from all over 
the nutioii by one of their leaders and i)eeause it clolhed this 
business philnsopliy and praulice with the niautle of seienee.^ 

While this event relates to the origin of niodarn coneeptjs of 
accoimtability, other signifleant events occuiring duririg tliat <ua 
rc^flect an entire rarrge of aetivitieSj influenefug sciiool aec<nnii- 
uliilit)^ not only then hut no^r. 

Year Emnt Ralaicd io account cMitij of 

1911 Educational cost accounting Scliool adrninistrution 
recomniendcd 

1912 Bricflng of school superintend Scliool ad ni in is t rat ion 
dents on use of school survey 

1912 MeasurDment of edueatlonal Student-Teacher 

efiiciency (adaptation of F, 

Taylor method to education ) 
1915 Student eflicieney test Student-Teacher 
1918 Report of tlie Gary or Platoon Scliocj] ndminislratign 

Plan— more eflieicnt use of . 

school space 



^ Ibid,, p. 73. 
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Toucher efficiency record Sdioul administration^Tencher 
liicToase in class slm to de^ St'honl adrniMisiruiion 
crease Hvhuol expciKscs j^cc- 
ommendcd 

Advent of schcol public rchu Sulic.ul adnuMlstrntiou 
tioiif: 

Eiicli avt'iit influencetl u clilFercnt nHpcut of HcIiool opur- 
aUan: IQll^biidget or financial record keeping; 1913— schnol 
surveyji a^^ a tcdiiiiquo lor reporting seliaol cfFcctivencss; 1912 
and lOlo— prccisu rneasiirenicnt an a motliod for dotoniiininfr 
student learning; IQlG^more drcetive ma of ^dionl spncc; 1917 
—early atteniptH to nsmm teudicr eirectivencHs- 1923— nmnipu^ 
lation of dans sIzg to deerease per pupil qohIs; and 1925— adniin- 
istrativc reporting In iniUumce coiiinnmity Hupport for selioolx. 



1917 
1923 

j9Q2 



Hecent Origins of Accouutabillty 

\Vliile it is not alwaj^s possible to relate acts of individnalH 
duectly to a set of given results, recent events concerned with 
education and the schools suggest that our political nnd educa-^ 
tioniil leaders are prinKirily responsible fur tlie renewed intercut 
in accountability, A numljcr of spokcsinen and IcadcrH in govern- 
nient agencies have recomniended tliat accountabilitv and per- 
fornianec .contracts be awarded to contractors wiiliniT to negotiate 
mdi cojitracts, Lessinger and AUc^n state that edueators should 
be "requirod to deHcrihe and measure the bebavior expected of 
eacli .student upon completion of the program thev propose for 
funding." ThiH Phi Delta Kappan article is one product of earlier 
work done by LcHsinger who at one tijuo was afBIiated with the 
U.S. Office of Education, ^rudi of Lessinger'^ \vork was prepared 
lor the Kpecific purpose of renewing or cle\*cIoping ideas relating 
to aceountability in education. 

Political leadei's have been influential also in stimulating in^ 
terust in modern concepts of accountability. In his 1989 *^State 
of Education" address, President Kiehard M. Ni^con stated that 

«Le(in M LosHlngor iind D, M. Allun, ^Terfoniinnce Prosposnl^ f(ir Edu" 
cntuinnl Fiinding; A New Approach to Fedcrul Resniirce AllocatiMn " P/j* 
Delia Kappan 51 (Noveiidier lt369)j 136-37. 



llieru is "a cojTespuncling licutl in tliu Nclinol ^iystcMiis nt IIhi 
nation . . * to begin responsible open nitni8in%Miic*nl: of liow wt^ll 
the cclncational process \s working. It mattcjrs \'cry little Iiosv 
much a school building costs; it matters a groat dciil how much 
a child in that building leanis. . . He continuoH, "Wo have, aH 
a nation, too long avoided thinking of the productivity of schools/' 
He also pointed out that althoiigh wc are Hpcnding more on 
education in this country than in the entire rest of the world 
(65 billion dollars), we are not getting u significant rettnn on 
that investment 

Although President Nixoii did mention that we spend 65 
billion, dollars in education, be failed to mention that we spend 
less than two per cent of our national budget on education. Sue- 
on dly, ho failed to montion that the high cost of education in. 
the United States is related to the high standard of living in tliis 
afriucnt society. So, although there were 66 billions spent on 
educationj relatUTly speaking ( i.e., relati\^e to the gross national 
income) this is a very small smn. The most serious error in tlin 
President's message probably was the statement, "We have, as a 
nation^ too long avoided thinking of tbe productivity of the 
schools/' The history of American education in the twentieth 
century is filled w^ith the concern of educators for the 'produc- 
tivity of the schools*"*' 

Another possible reason for the renewed interest in account- 
ability is that it IS view^ed once more by educators as a w^ay to 
answer critics of the schools. If any institiition has been society's 
scapegoat, it has been the sehooK Schools have been and are ex- 
tremely vulnerable to public criticism. Since they arc supported 
and controlled loc^ Uy, public criticism and pressure can be 
exerted in various ways. 

One impact on the curriculum has been to re-introduce 
scientific management techniques as a means of eliminating waste 
and of iniprovin.g the efficiency of the schools. Consef{iiontly, a 
number of program evaluation techniques (cg.j PERT, CTPP) 
were promoted as unique efforts in scientific management of 
schools and school-related organizations. An analysis of the 
models for efficient management promoted in the pant two 
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uUcriiati%^c t'diicationaK syHtcMiis. T!ics<* six alU*rnativt^s Hcvm to 
reveal tlio mnjor difrorcncos between the older and newer con- 
cepts of accoiintdnllty. Modern accountaljility conccptH ura jiiueli 
more coniprehensivc and pro\ idc for many nioro altcrnutis'es. 

Problems with AccouiitabiUty 

One aceountabllity problem, which was identified earlier in 
the century and still remains, is that of mcasnvcmcnt, Educutors 
in tlio eurlior part of tlie century recogniOTd the difngiiltics of 
measuring educational achiovemcnt One cninment made in 1913 
is ai^proxiriatc today; *lf scientific measurenicnt is to bo accom- 
plished, we miu^t have units or scales of mcas\u-omcnt which will 
enable us to make mcasurcnients which arc veriflable by other 
obgorvers. Wo may not hope to achieve progres^_ except as such 
measuring sticks are available or may bo derived." What is ap- 
parent in this statenicnt is that educators realized tho necessity for 
valid and reliable measuring instruments even then. 

More reccndj% there hai been a growing dlssatisfaation with 
the tecliulcal development of modern standardised teste.^^ This 
is especially true in reading, where standardimd tests aye inap- 
propriate for evaluating tlio reading behavior wlilch should be 
cvaliiatod in any program holding students or teachers account- 
able. Earlier cducatorH saw the need for developing appropriate 
tests. Modern educators, after having evaluated valid and reliable 
standardized tests, are calling for new kinds of tests. Glascr and 
Nitko suggrst that new kinds of tests bo developed to measure 
instructional outcomes. "Tests which are u^^cd for niaking instruc* 
tional decisions demand special charaetorlstics— characteristics 
that are different from the mental test model that has been suc- 
cessfully applied in aptitude testing work " They go on to state 

10 CaUnlian, Edumlton and tho Cult of Effwicncih P,. 1^)1* 
'iScG Roger Fiut, llmuVmu\ What Can Ba Mamurad (Nawarkj DcKi 
KRIC/CUIEU nnd Inlematioiml neadltig ANSOuiation, 1969); nlso Stepbr^n 
D. Klein, "Tho Uhgs and Limllations of Stantlrtrtlizcd Tests in Meeting Uio 
DenmnclH for Aceoiintnhility/' UCLA Emhiatlon Comment 2 (Jannnry 
1970), 1-7, 

Robert Glrtsor and Anthony J, Nitko, **^^p^.sum^np^^ In Lonmliit^ anfl 
Instmctlon," Edumthnal Mca§uiwnmtt, mh Rolieit L. TlKiriulllcG (Wrish- 
Ington, D.Cj Anmrlcnn Coiinfiil on ICdiiuntion, IfJvl), p. Cm9i, 
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that special typcH of criteria need to be dcveiopccl Of signiflcanL't' 
are (1) tlie crentton of Items from stated objectivcisr (2) the 
creation of Interpretive materials for such tests in terms of test 
content and criteria for performance as well as references to 
norms for other test-^takersi and (3) the extensive application of 
test pcrfonnance to domams of content from which the test items 
were sampled. In essence, modern educators are calling for cri^ 
terion^reforenced tests which interpret an individuars perfonii^ 
ance with respect to a defined behavioral criterion and which are 
not limited to a comparlsdn svith the performance of other in- 
dividuals. In addition, tliere Is a need for other newer methods 
of measuring student behavior related to the affective domain. 
Finally, there Is a need for personnel education that will prevent 
niisadminishation, incorrect scoring, and misinterpretation of toit 
results. 

The focus for modern evaluation schemes related to account- 
ability is broader than earlier attempts at accountability. Teacher 
behavior was measured by rating sheets; principal behavior, by 
rating scales,^^ Little information was gatliered on more complex 
aspects of student, teacher, or administiHittve behavior. Conse- 
quently, early efforts at accountability were less than effective. 
The instruments used to observe and rate teachers and principals 
were neither valid nor reliable. Reality has not ohanged drastically 
in fifty years- dieory has.^^ 

A concern not mentioned in tlio earlier history of uccounla- 
bility but signiflcant to modern education is cuiriculum articula- 
tion, In a number of current accountability s/stems (such as tlie. 
Banncker School in Gary, Indiana), eumcular articulation was 
not considered Initially, Only after the Indiana State Department 
of Public Instruction intervened did the contractor attempt to 
Justify and articulate the curriculum already Implemented in the 
school. In the Texarkana Project, a lack of articulation or even 
of teacher cooperation was noted when some studenfa performed 
successfully in the reading part of the curriculum (as indicated 
by teacher grades) but failed in the regular curriculum of the 
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Eiiglisli alasKt^s, liotli reudiiig and linglish wcru HiippOHod to hv 
part o£ the same aurriculiini. More Important than tlie grading 
pmcticos in the curriciiliini aro the teaching and the learning 
which should take place from one gradu level to the next It is 
nnt uppnient that articulatinn wa^ identiflod ns a problein In 
earlier accounlabihity piogrnms. In today's program, there is at 
least the awareness that it may be a problem. 

It should be noted, however, tliat tlio issue of ciivrieiiluin 
articulation in accountability is more serious in some flelcls than 
in others* For examplDj because there is no scientiflcally based 
reading curriculum, articulation is less critical in reading dian 
in some other areas. The curriculums of the most widely used 
instructional approach (basal and basic readers) are developed 
by authois and publishers. The skill sequence and content are 
usually determined by what logically and pedagogically appears 
best The language iised is often not determined on the basis 
of what is known about children's language usage but by what 
appears pedagogically wise. Probably the most critical aspect of 
this issue is whether or not the content of the material is palatable. 
Will the children read and enjoy the matorialP Will tlie material 
in some way parallel the life experiences of the ^childrenp Is the 
material in lino with what we know about children's interest and 
tastesP 

In addition to measurement and articulation, another con- 
sideration slighted was the long-term effects of the instructional 
system, In some current accountability projects, contractors re- 
fused to negotiate a delayed testing program to detennine 
whether the student gains were permanent or whether they would 
disappear after six months, Short-term gains are characteristic 
in educntion. It sc* ms essential tliat in any educational program, 
attention be given to the long-range effects. Nevertheless, it seems 
that modern educators are not as concenied with this problem 
as they sliould bo» OthorwisCj accountability contracts would re- 
quire that the contiacting agency bo responsible for long-range 
results as woll as short-term results. The contracts NVOuld never 
be for only one year* Only long-term contracts allow the schools 
to evaluate accountability as a mechanism of change, 

Long-range planning relates to a fourth problem: tlin proh- 
lorn of attaining affective goals in acGountability contracts. FDrmer 
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CaipmiKsionc^r of Education, James Allen, made issue of tho aliec- 
tivo clamai.4 in his Bight to Head speech. His niain gonl for the 
1970h included not only the skill to know how to read but aho 
lliG desi'a to mad. From the dcscrJptlons of some modern ac- 
countabjity contracts. It is apparent that thcMT cQntraclors have 
given this soiTic thonglit, Howuver, only measures of cognitive 
skills \vcvc u.^cd to cvahiatc the Tcxarkana Project, Mctliods and 
tecliniques iocusshig on the afFcctive domain were not appaient 
'in carh'er nttcmpts to deal with accountablHty, In more recent 
times, it bucim that educators arc knowledgeable about account- 
ability but fail to give due consideration to the assessniCxit of 
affect — in reading instruction at least This nuist clmngu. 

An aspect of accountability focusscd difFGrcntly today is 
teaelier impact. From one viewpoint^ accouiitaljillty may roquiro 
the devolopment of new relationships with the teachers^ tenchcrs* 
unions, and other organizations. Frdm a second vio\\Tpoint3 ac- 
countability may need close observation and control Will tn- 
diDidtwl teaahen^ still ha ahU to practice tha art of teaching? 
Or will teaching hccomG skill or icntad drudf^ryP Although in 
earlier times teachers' unions worQ not a concern, tlie "art" of 
teaching \vas. Today the two concerns should be combined. 
Teachers' unions will play a role in nogotiating accountnbiHty 
contiaets^ therefore, they should reflect a concern for the art of 
teaching as well as tlie skill of teaching, 

Involving t]ie comnnmity in the educational decision-making 
proceHS is also a problem in the accountability process. Thero 
have been u number of oIFectivc innovation.^ lost to the schools 
beeauHo of inHensitivity to the local community* Today parents 
want to partioiputc in any declHionMnaking process that nffects 
tlio school life of their child. In carher times, as well m today, 
the community stimulated the growth of accountability systems. 
It IS not quite clear what role the comnnnn'ty will play beyond 
this in modern accountability programs, 

A final and probably the most STucial problem related to 
nccDimtability is evaluatinn. At the present time, dilforent views 
of accnuutabiiity suggest different approaches to evaluating 
school programs, Somo are concerned with student acluoveinent. 
Others focuf? attention on teacher bahavior. Still othci^ are con- 
cerned with administratiVD bohavion Whatever tho dimensions 
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of accountability are, tho cvaliiatigii plan inust correspond to tho 
agCQuntability plnn^ and a Kuincicnt nuinbcr of trmiied porsomiol 
mu^t be available to implement the uvuluation system. In earlier 
attempts at accoiintabilityj coniprclK^nHLVc evaluatiun planH wore 
unknown. Today they ai ■ considered vital to the success of a 
piogram. 



Summnfy 

In this paper^ concepts of accountability ^^'eru related to an 
earlier e/Hcieney ^ra in cducatinn^ described in terms of the mnrc 
recent originH of today'^ accoiuitability, and analy^^ed in regard 
to problems rulovant to both older and newer idea^ of account- 
abilily, Obvloii^ly, nceountabihty 'needs to be deflncd op'^ration- 
ally to meet the cDntracts and demands of the gov'erning agency. 
The realities and failures of aocountability in tho past will enablo 
educators to avoid those failiu^es in the future, 

You may perceis^C that I have a positive attilude toward ac- 
countability, I asHine you that I do. But only bocaiise I think that 
accountability can have a positivo impact on the process of 
educating cliildrun, And because I beh'ovo that the only way 
accountability as such will have a positive impact is for educa- 
tors to reject cynical and skeptiaal attitudes toward accountability 
and to sci^c it as an opportunity to hold the public accountablG 
for the rcsoureos and support needed by the schools, 
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In tills .short papc^r^ I shall set foi th somQ views about ha- 
baularat ohjectims, some principal nssumptions tlmt underlie 
them, some statement^ of tlieir asserted puipoios, and some issugs 
in relation to behavioral objocti\^es as they pertain to reading. 
Before doing so, however, it is useful to place this brief discussioii 
of behavioral objectives into its larger educational context 

Ah a social institution^ the educntion entcipriso has always been 
liable to societ)^ for its successes and failures In educating the 
nations cliildren and youth; ^'accountability" is not a recent intro- 
duction into American public education. Yetj today, during a time 
when national and international turmoil is causing us to look 
deeply at our traditional valuosj even greater demands are being 
made than has historically been the case for the nation s schools 
to roafflnn their credentials as society's formal educational 
agencies, ^Terformance contracbi " "voucher iDlanSp" and the like 
are all symptomatic of pervading social forces which bring pres- 
sure upon school systems, tlielr personnel, and their instructional 
programs to demonstrate both efllciency and effectiveness in 
educating the young— In short, to be accountable. 

The larger (and more significant) question of '^education for 
what?" cannot be examined In the limited space available here, 
For present purposes, we shall assunio that education may he 
comtruecl as a change in bGhamor toward some acceptable goal 

J3 
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TJio set of gouls for whieli education is responsible includus tlie 
agquisitioii of buHic imdcrstandings of the world in wbicli we 
live, basic couipetoncies for eirccti\'c participLition in tlic larger 
society, and the basic vahics upon whlcli tlie Hoclcty resbs. In 
nhort, educaUon is the process for the transniission of the preniiHo 
tliat certain knowledge, skills, and values aro deumed iieces- 
sary for individual fulfilhnent and for the niaintcniance of the 
social order. It in these educational outconies tliat are subject to 
u 'coHt acc%auitirig',arid give paiticular support to die notion of 
hehaowml ohfcclwcs, 

^Vluit Are Behavioral Obicctivcs? 

Buhiivioral objeetivos are clninicd by their proponents to be 
a teclnucnl dos'ico whicli can impros^o the effectiveness of schooU 
ing. Tangibly o\MdcncG tlmt objectives are in fact being reached 
Is provided in tho form nl; obmrmd behavior njaiiifested by a 
student in relation to a particular objective; llio statement of the 
ubjucLiv'j identines \N^hat behavior a student should demonstrate 
\t tlie ol>jectl%'u i^ achieved. Here is an exaniple of a behavioral 
objeetivu in reading as applied to a populution of pupilsi 

To intTeuHe die reading achievament and skills of disadvantuged 
iirst^gnide students as mea?iUfed by the total scores obtained on 
tlie Stanford Reading Achievernent Test, Primary Battery 1^ in 
wlndi llie following is obtainudj (a) a 25% decreaso in the 
ruimbor of .students Qntcring tlie soeoad grade *,vho are one-half 
or mere }'ears behind grade les^d Uiaji was Iho case for the 
prcvions yuan and (b) an averugo of ,3 inereaso hi the grnde 
kwel aehievGinent of studeiits enlGrhig the second grade over 
those of the preeoding yoar*'^ 

We should remind oursehes that educational objectives are 
valuG fudgnmnts aboiit the ends of educationi thus behavioral 
oljjectivos also are value judgments of ends that arc stated in 
terms of observable pupil behaviors, They are viewed as a means 
of identifying goals and of describing the outcomes of Instruction 

^ If, IL NtcAshun, WvHInfi BaJunmral Ohmtlvcs^ A New Apinoach 
(New Vorki Harper & \\o\v, PiihliHhar*?, p, QT, 
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in tGiMiis of perforinaiiees that diiUIren sJiaiild Imve an the result 
of their parUdpation in nn instiuctional activity. 

Aecording to this viow, any svovthwliile u£ft)rt to iinprove 
educatloiml pro^rains imist include proper idcntincation and 
du^icnption of sp&ifle hehaviornl objectives if the progrnm is to 
be evalunted. For, imiess tliose objee'-lves iiniqu^ to a given 
area of study are clearly stated, the isupil thti tcachGr, and tlie 
prograin .phmner will not know wiuit Is to bu done, how it i.s to 
bo done, or when the goal ImH been aecoiTiplished,- Behavioral 
objectivf^s are seen, in shorty m n ^ignifleant way of helping every- 
one wlio is involved in an educational actisHty to clarify what the 
goals of that aotlvlty are and what criteria to einploy in deterniin- 
ing if those goals are attained. The proponents of behavidral oh- 
jectLVos tacitly uHsunio that insiructlonal goah can bij .stated m 
lenm that command agreement as la iheir rcfemnne by all who 
ma ilikm. 

Major Suurees Givmg Rise to Behavioral Objeellves 

It is signiRcajit to point out that the impetus for behavioral 
objoctivDs has eniorged from outside the partieular subject fields 
to whioh they are genorally applied, In the main, the beliavioral 
objectives niovenient represents an amalgam of systems analysts, 
behavioral psyebolqgists, and nieaNurement thoori^ts who, from 
their respective vantage pohits, requfre tliat outcomes of an ae- 
tivlty be nicasurablo. In tiu n, these forees ha\^e had a significant 
impact upon curricuhnn decision-niaking jn recent years^ U'here 
the criteria of efRcienoy and effeetlvenGSs are yardsticks for evah 
uating instruetiun, Thera aro comlant pressttrm to gim priorily 
to thosG cdiicaiianal goals tJtat can be moH ejjectimlij and effi- 
ciently attained, to do thai ''luJiwh icorks/' 

Views of Knowledge and the Learner 

Further embedded in the issue of heliuvloral objectives are 
substantive matters pertaining to lioiD and wliat wc learn— to 
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th(3 psytHu^bgles and philosopliies tlmt guide us. Behavioral objee- 
tives arise m part out o£, and are clcnrly nourished b>% stimulus- 
response c ninectionist learning theory in which learning is 
Viewed rncciianistical]y and u'liere precise statements of fact, care- 
ful observation, and liinlted induction are accepted as paradl»4nis 
of knovvledge and thus ac paradigms of human behavior. Tliis 
frarnework, of course, contrasts with tliosc views of learning 
wliicli aecummodate the imaginntives the intuitive, and "dis- 
eovery" as fundamental attributes in tlic consti-uctlon of knowU 
edge. 

Accordingly, from tlie belmvioriHt s view, knowledge Is pru- 
sumed to be certain and absolute as opposed to uncertain and 



same for all) as opposed to dio view that experienQ^ls. trails- 
formed into personal schema which further guide an indivlduar^ 
interaction with tlio world about him. Froin the DeJifioloml mew- 
point ihG. child regardad hrgely as the recipimt of knowhdge, 
rather than heing men as an actim participant in its creation, 

A Brief Critique of Behavioral Objectives 

I liave briefly reviewed some underlying aspeets of bcliavioral 
objectives which lend perspective to a more practical examinatibn 
of tlicm. Three underlying features of behavioral objectives that 
have been pnipolnted are (1) there is an assumed consensus 
about the goals of instniction; (2) an emphasis is placed on thoso 
instructional activities that "work" and are measurably workable^ 
and (3) what is learned and how it is learned arc regarded es- 
sentially as the same for all 

The consequences of tliese points hi respect to cunieulum 
development and teaching method raise a number of signlflcant 
questions^ rirst, from the behavioral objectives viewpoint, it can 
be argued that only that which can be tested is that which can 
be stated objectis^ely; the hiference is that only what can be 
tested shall be taught. Given this argument, the curriculum de- 
velopers task and thu teachers responsibilities are clearly de^ 
lineated, if not prescribed. When this mandate is cqppUed in 
extreme form, a premium is put on the teaching nf Information^ 
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on rote recall of cleflnitions, rules, and princIpleSs and on the 
solntion of problems with only one solution, (riow can divergent 
tliinkfng outcumus bo stated in belmvioral terms; as, for oxmriple, 
'TIow niany things cnn you do widi a paper clip?'') Learning 
thus becomes a "pinnncd happening,"-^ The adlicrcnco to be- 
havioral oljjectives necessarily precludes tlic belief that leaming 
and knowing can Imvo tacit (personal) dimensions as well as 
explicit ones.* 

Second^ there is a belief that observed performance in an 
instrnctional setting is conclusive evidence that the i^upil has 
mastered a behavior which has been taught But^ children (and 
adults) sometimes behave as though they have learned when they 
have not; while, more significantly, they sonietimes learn without 
overtly displaying behaviors that %vould give tcstiinony to the 
learning. Coupled with the realisation that students have diifcrent 
capabilities for learning and different attitudes toward learning^ 
it seems presumptuous to apply the same odueatlonal standards 
upon which behavioral objectives gcnerany are based to all chil- 
dren in all circumstances, 

Moreover, teachers also differ in their abilities to teaeh and 
in their st>^les of tenehhig; they bring to an Instructional setting a 
range of competencies and backgrounds whieh parallels that of 
their stiidents, Where behavioral objectlv^es strueture the ehilds 
learning situation, they in turn constrict the teacher's range of 
instructinnal alternatives* Bollt teaclier and pupfl can become 
constrained by the planned bappening. 

Thirds tliere is a belief that we oldior know or can readily 
identify the educational objectives toward %vhich wn ought to 
strivoi Any curriculum that is used by real iieople will have out- 
comes that eannot be anticixDatcd. Of those outcomes that can be 
readily identified, fewer still are readily translatable into l.^e- 
havioral terms. A dangar exists that a curriculum bGconms onhj 
those outcomes that can be readily spmifwch As Atkins has so 
clearly said: 

^ James MacDonald and Bomice J, WfjIfHmi, "A Case Against Bo- - 
havioral Objeetives," Elsmmtnty School Journal 71 (DccBmber 1D70), 
119-28. 

* Harry Hroitdy, "Can Resenrch Esoape tlio Dogma of Bohavioral 
Objectivei?" School Rei>lew 70 (Ngveraber 1970), 43-56. . 
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, . . it is difficult to wmt llio assuniptioii that those aUributus 
which wc cun measure arc the dements which wo conHider most 
imporlunt. . . . The bchavibnil anulyst secnis to asjiume for un 
objective to bo worthwhile, we niust have methods of observing 
progress. But wortluvhile gouLs come first, not our nielhods for 
aHsessiiig progress toward these goals. Goals ore derived from our 
needs and from our philosophioH, They are ont and shoiUd not 
lie derived primarily from our measure. It borders on the ir- 
roKpousiblQ for tlioso who exhort us to stute objectives in behav- 
ioral tcmis to avoid the issue of dcterininir^g worth. luevitiihly 
there is an impheatiou of worth behind any act of measurement. 
What die odueational community poorly reaUze.s at the moment 
is ihat behnvioral goals may or may not be worthwhile. Thoy 
are articnUited from uinong the vast library of goals beennse tliev 
are stated relatively easily, . . . Lot s not assume that what we 
enn presently measure neees^arily roprescnt^ our most important 
activity,^* 

Bohavioral Objectives and Reading 

So far I have made a brief explication of behavioral objec- 
tives withoLit making particular reference to reading. My reason 
for doing so ha^ been to keep the focus of our attcMition on the 
matter of hcJiamorol ahlectlves as the basis of our discussion and 
to avoid the possible dispersion of our attGntion to tlieorles of 
reading, a signiflcant issue in itself, In order now to put reading 
into the context of behavioral objectives, I will assert tliat reading 
iH a t\vo-fold process tliat involves the transfarmntion of written 
forms of language to meaning— that is, tho cJecoding of and the 
cwmpralwnsion of tho printed message. 

Aspeets of the decoding process am, of cunrsCj more suitablG 
to direct observation than are aspects of the comprchGnsion 
process* For, whilo an individuars abilities to decode may be 
ninnife.sted through various word recognition tasks, the observa» 
tion of his abilitios to comprehend is less certainly grounded. Does 
not the meaning o( a work of litoratiu'e, for exaniple, become 
known only to the individual who interacts with itP 



^J. Myron AtWns, *'Ilehavioml Objcctivo.^ in Curriculum Design j A 
Cautionary Noto/' Sdcnaa Teacher 35 (May 1068), 27^30* 
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Measuring aititudcs toward rending is an uvcn moro ohiHiva 
proccdiirc. It seems clear that~in rcspoct to rnading— decodiiig, 
coinprohcnsion^ and attitudes can be cast into bclmvlura! tormg 
only at thn cost of decreasing levels of certainty as to the relia- 
bility of the measiu"emcnt as one progresses frojn skills to under- 
standing to afFect. 

A Sunimation 

I slionld like to close with somu observations that 1 thiiik 
should l>u cunsidercd regurdhig behavioral objectives vls-a-vis 
reading. Fii'stj I believe that there is an over present tendency to 
regard tlie demonstration of reading skills vvhieh ccm mast easily 
ho obsGrDod (for the most partj the decoding skills) as the read- 
ing x^vocoss. The ability to read is not simply tlio sum of word 
recognition skills; knowhig is more than the sum of the j^roccsscs 
which I^. d to it. 

Second^ liow the child is perceived, how and whnt he learns, 
and how schooling should bo structurGdj as viewed througli the 
template of behavioral objectives^ wafrant careful consideraHon. 
A rigid adlierenco to behavioral objectives, if not prescnbing 
one's view of readingj at least puts blinders on the viewer and 
narrows his range of visible alterl^ati^'cs. 

Thirdj there is a growing fetish among proponents of bo- 
havioral objectives to regard the process of defining behaviora] 
objccti%^cs as an end in itself and to assiune that there are .siniplo 
procedural solutions to the many complex problems of cducatiom 
Behavioral objectives^ of themselves^ arc neither good nor badj 
but can be either, by tiiose who use them, 

For reading in particular, belnnloral objectives oiight to bo 
viewed in terms of their limited utility, partieularly in respect 
to those skills where they have the most utility. As to the higher 
cognitive functions involved in reading comprehension^ as well 
as hi the affective aspects of reading, their limitations should be 
recognized. | 

Reading rescarchcrsj developmental psychologists, and| lin- 
guists are now exploring new frontiers of knowledge about learn- 
ing, InnguagCj and rending and rnising ^significant points about thu 

\ 
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efflcacy of the assumptions and tiieory iiiiderlylng behavioral 
objectives. Perhaps one of the principal but unforc-seeii outcomos 
of diD behiivioral objectives movement is tliat it causes us to ask 
oiirsdvc^ what we iruhj believe ubout the iiature of the child 
and the function of schooling, 
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A GENERAL CRITIQUE 



Never in the history of education have reading tests enjoyed 
OS inuch status a*i tlicy do today. They provide a data base used 
increasingly as a means (often the sole means) of evaluating 
pupil pnigress, teacher efFoctivenessj and program success. They 
are used in research studies to compare methods and muteriuls* 
They are linked by hivv in several states with special or basic 
state support for tho schools. Schools and school systems are 
pubhcly eornparcd on the basis of rankings of pupil populations 
on reading tests. Election cajnpaigns of tun cunter on pupil per- 
formance on reading tests. Publishers and private contractors are 
.sometimes paid on the busis of student performance on reading 
tests. . ^ 

It is ahvays desirable to ro-evahmte the evaluators we use 
from time to time. With so many crucial educational decisions 
being based on reading tests, this rc-evahmtion becomes urgent. 

Uses of Reading Tests 

AbovCj reference has been made to some of tlie current uses 
of reading tests* Only two basic uses of reading tests are legiLi- 
niate. They are as follows s 

(1) To measure the effectiveness with which any person uses 
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rouding to compruhencl writicii lunguagc. Within tlm, llie two 
nuiiii conccmH iiio (a) flexibility in comprcliencling a wide range 
of niulciiulH unci (h) dngroo of prunciciicy as compurud to otlier 
ruadcTs or as coinparod io somu ah.solutij Hcule of proficiency in 
conipruhonding wrilluii language. 

(2) To dingnosg tlic sLrcMigth.s and weaknesses of readers as 
an aid to planning instnicUon which will help to niake them 
more enective. 

Testing for each puiTpo.se will vary depending on the theory 
of the reading process, and of reading acqiiidition which the tmtov 
mas. In sonie cases, readiness tests will be used if the tester be- 
lieves that there are nonrcading tasks which nuist he mastered as 
prerequisites tr siiccessftil Acqiiisltioii of reading. 

A major weakness of current reading tests is a failure to 
urticulate views of the reading process and of learning to read 
as a basis for building the tests, subtests, and test items, 

Tests are often built on ecleetic traditions of what is ini- 
portant in reading and learning to read These are sometimes 
derived directly from popular instnictional reading programs; but 
just as often the insfa'uctional programs derive their rationale from 
the tests on the theory tliat if something is commonly tested it 
must be important Tliis misuse of tests results in a self-Justifying 
eyele which institutionalizes tradition. 

That cycle tends to block progress in improvement of read- 
ing instruction through the application of new insights from re- 
search, theory, and practice. The tester says we must test what 
is being taught; and the teacher says we must teach what is being 
ti^sted. Innovative programs are Judged on the basis of perform^ 
an CO by pupils on traditional tests which incoiTp orate the samn 
faidts tiint the new programs seek to overcome in old programs, 

Since tests grow from tradition rather than articulated theory, 
Uiey develop subtests with large areas of ovei'lap, while leaving 
gaping holes that arc not tapped at all 

The successful reader is treated as a posse.^^nr of bundles 
of skills rather than as a user of written language. Traditional 
semilogical, sequencing ciiteria and hierarchical arrangenieiit^ 
are imposed on these skills which arc Isolated^ for ease in testing, 
out of any context of language use which they may have. 

In the absence of a strong base in reading theory, current 
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reading tesb subHtitutc sopliisticutetl tot tlicuiy. Surmuncled by 
norms, porcentilcs, nieasures of significance nnd otlier statistical 
armor, the tests give an impressiQn of scientific validity which 
coneeals their hollow cores. 

Tests, any tests, will prodnco statistical results with popula- 
tions that take them. These results can be matlicinatically manip- 
ulated. By adjusting the test itenis on the basis of die statistics 
dicy produce, one may achieve neater statistical patterns, But in 
fact one may never dra\v conclusions whose significance go 
beyond the validity of the assuniptions on which the test is based. 

Criterion-referenced tests, those which measure achievement 
of stated goals ratlicr than conipaving to a statistical norm, are ^ 
even more in need of being rooted in a strong dieory. In reality, 
they tend to be selected skills arbitrarily scqiienccd, 

Siatistical Fallacies in Reading TGating 

There are a number of key statistical fallacies that are widely 
incniporatcd into Justifications for misuses of reading tests. A few 
will be explored here, 

Norming omr cUmrse populations. Sophisticated test theory 
dictates tliat norms or percentiles should be devoloped by admin- 
istering the test to a stmctured sample of the general school popu- 
lation. Care is I ' n to include the right proportion of urban, 
suburban and rural pupils, white, black and other; east, west, 
north and south, and so on, These national norms or percentiles 
are then published. The implication is that the test is valid for use 
nationally. Though test-makers often suggest that schools may 
wish to use regional or local norms, tliere is a clear impHcation 
that individual pupils, classes, schools and districts may bo use- 
fully compared to the national norms. 

But now let us introduce just one condition. Suppose that the 
tasks and questtons on the tests are selected so that they favor 
one group (white, suburban, middle-class eastern pupils) over 
all odiers. This could be the result of choosing to deal with ex- 
peiicnces and conceras more common among tlie favored group* 
DifTerences betxveen groups then would be at least partly the re- 
sult of the relative relevance of tlie test and not any actual diflFer^ 
once in reading effectiveness. Furthermore, simply using local 
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noniis wuuld not rcMncdy this problem^ rincu pupils' scores would 
reflect the dugree to wliich. they matched the favored group in 
background. Now add to this prob^eni regioniil iind social dialect 
differenccSj and tlie justification for national use of the test 
through a structured sample is even niorc highly suspect. Only 
if the test-maker argues that in fact all pupils should be judged 
by the degree to which tliey compare to a high status group is 
sueli norming justifiable, and such a Judgment involves value 
questions which cannot be answered statistically. 

Tim impOiiance of small Dariaiiom in tost perfonrmnce, The 
sUitlstical treatment of raw scores on reading tests makes it pos- 
sible to equato them to grade phiccment— the grade of the aver- 
age pupil who achieved tlie score in the norming trials. 

Since the test must use a limited nunibar of items because 
of time considerations, tlie differences^ particularly at the upper 
and lower ends of the scale between tlie average score In two 
adjacent grades, may be only a few^ items, One more question 
nght can add several months to tlie grade equivalence of a pupih 
Consider this in relation to the relevancy questions raised above 
and it is clear that a slight bias against a group can explaui sta- 
tistically significant dLfFerences in group nieims. 

Sky-liooks, ^pllt-haloes, etc. To cope wltli questions of whether 
tests are testing what they should and doing it consistently, a 
number of statistical devices have been employed, One used 
particularly for new tests is to correlate them with other older 
tests. If a high correlation is achieved, then validity is assumed. 
However, if tlic new test is in fact measuring what the old test 
did, then wliy is a new test needed? And if the new test employs 
new insights, why expect it to correlate with the old? This sky- 
hook method of anchoring tests to each, other clearly says nothing 
about the extent to which reading is really being tested, A current 
federally funded project seeks to establish a new test to which all 
current tests could be correlated. Such a test^ appropriately called 
an anchor test, would surely anchor reading permanently to the 
past. Similarly, using split-half techniques to pro^^e that a test is 
consistent wi&in itself proves only a symmetry on whatever biases 
are built Into the test and does not offer evidence about the value 
of the test. 
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Hard Is Hard But Why Is It Hard? 

Tust theoiy requires tlmt sonie items should be missed by 
most pupils, and some items by a few, with the rest of the iteuiH 
ranging iii^ijetwuen. Finther, the higli scurciv^ should be tlie aue^ 
getthig the hard itenis right, and the low scorers should be the 
ones getting the easy items wrong. Close exaniinatioii of reading- 
test itenis reveals tliat the items me often difRcuit for irrelevant 
reasons: ambiguit>% equally correct wrong alternatives, and so 
forth. The faet that few people get them right may indicate that 
they are hard, hut it may also indicate that they are irrelevant or 
poorly written. The fact that the right pupils get them right may 
demoiistrate more that high scorers are good at thinking hke test 
writers than that they are better readers. Again, what is iniportant 
is that statistical evidence cannot substitiite for intrinsic criteria 
in judging the relevance or difEculty of items. 

Related to this statistical fallacy is an ailifact that results 
from weighting certain items by virtual repetition (a series of 
very similar items). A pupil tends to get all like items right or 
wi'ong if in reality his perfonnancc reflects knowledge or lack 
of knowledge. A minor lack becomes magnified into a major weak- 
ness. An example of this is the syllabication sections of certain 
tests, 

Amraging Ends and MeanB 

A statistical fallacy occurs in many reading achievenient tests 
when an overall score is calculated which combines scores on 
"skill" subtests with those on comprehension. Since skills are 
ostensibly the means by vvliich comprehension (the end product 
of reading) is nclneved, such a score is meaningless. 

Counting in Diagnosis 

Statistics which produce summary scores are nuieh easier to 
manipulate dian tliose which relate to complex phenomena in 
detaih The effective use of diagn.ostic testing is often defeated by 
being more concerned with quantity of errors or a grade level 
equivalence, than with the specific phenomena re^•ca^ed by per- 
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fo nil an CO on tliL* reiicling tasks iiis'olvcd. Number of ruiidiiig eirors 
or Items wrong gives littlu diagnostic inFonnntion, 

Design Problems in Constiucting Reading Tests 

Aside froin the statistical fallacies confusing test use and 
misu.sej tliere are a nurn.bur of design problcins wliicb test-makerH 
have not yet Holved udequately. 

CoiwergencG, One of the most difHcult: design pioblenis in 
writing tests is that there must ahvays be a riglit answer, This 
leads to focus on convergent rcsponses^ — on those which match 
the prceonccptions of the test-rnaker. Two groups arc hanipered 
by siieli tests: cultiu'olly diN^crgcnt groups whose experience does 
not niatch the testers^ and creative thinkers who are able to see 
"dilTerent" relationships. If you march to the beat of a different 
drummer, the test penalizes you. 

PuplU who know too mucli. Multiple cboice responses are 
designed to niislead pupils witli common misconceptions. Since 
a naisconception is better than no cnneept at all, pupils are 
penalised for knowing a little and will be wa'ong more than 
chance would predict. Even worse off is die pupil who knows 
more than the test-maker. He will often reject the "right" answer 
because he recognizes it as a niiseonception or oversimpliflcation, 

WJiat they learn vs What they know. In testing coniprehen- 
sion, it is easy to end up testing general knowledge* The pupil 
nmy be able to answer die questions without reading the test 
selection. To overcome this problem requires a measure of prior 
knowledge or tests on rnaterial all pupils lack background for. 
The latter is a virtually impossible task, 

How test-wise am the mhjGcts? Pupils vary greatly in their 
control of devices for scoring higher on tests, Only some pupils 
have learned simple devices like skipping troublesonie itemSj 
quick identification of tasks, eliminating obvious wrorig choices 
to narrow the range of possible options, going to questions with- 
out reading test paragraphs or answers witliout reading quest ionsj 
arid so forth. There appears to be no way to neutralize fully this 
effect, which is also linked widi the pupils basic desire to do 
well (or his indifference). 

Honesty, Related to the latter problem is one of honesty. 



This is a complex problem bceuufje many pupil>^ avoid lining 
techniques which would produce Iiiglier scores. They think that 
is like cheating. In fact, those who give reading te^ts often hclia\-e 
hypocritically. Test-makers discourage guessing, tell piipilM to 
read each item before looking at the answers, refer to the tests 
with smaller cliildren as ''u game we're going to play." They 
tell pupils that the test is only to help them and that the score 
they make is unimportant. 

But in fact the score is the only part of the test in which the 
tesNmakcrs are interested, and decisions are made on the basis 
of the test scores, which may weU effect the learner adversely— 
placement in a low track, for example, T!ie pupil who is honegt 
and trusting becomes a statistical victim. 

How they do os What they do^ Since test-making involves 
counting right answers, there is a tendency in trying out test 
items to ignore the basis on which pupils respond to questions. 
In many casoSs pupils are producing both wrong and ri^ht an- 
swors for the wrong reasons. Subtests turn out to be testing some- 
thing quite different from what they claim to test. Auditory dis- 
crimination tests, for example, turn out to be testing largely the 
ability to deal with abstractions. Some pupils on such tests will 
resort to matching spelling patterns, producing a fair number of 
right answers widiout being able to abstract sounds from sound 
sequences. 

Making the test cJearrBuptis frequently do not understand 
what the task is that a particular subtest requires of them. It is 
quite likely that this nccounts for a considerable amount of the 
variation of performance, particularly among younger children. 

Distortion of tasks. Finding a forniat for test items \%'hich is 
suitable for inchision in a group-administered reading test fi'e- 
quently results in a distortion of actual reading tasks. Some 
amples follow i 

(a) Jtems too Hhort, Reseiircli on reading miscuG.s has denion- 
strated that short itenis are harder to rend than longer ones 
because reading involves building up expoctations on the basis 
of red undancies.^ A sentence is proportionately harder to read 
^D. Menosky, *'A Psycholinguistlq DeHcriph'on of Oral Reading MjHuues 
Generated during the Reading of Varying Portions of Text by Selectecl 
Readers from Grades Two, Four. Six and Eight" (Doctoral dissertaHon 
Wayne State Univenjity, 1971 ). 
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than a parugruplij a panigraph Imrder than a page, mid an 
isoliitccl word luirdest of all. Since short ilums predominate in 
tu^jls (words, phrases, sentences)* reading test items svill be 
liarder than reading stories or other natural materials. 

(b) Words in isolation are particularly hard to *read" beenuse 
tliere are no grunimatical cues from the sentence stmcture or 
mean in g cues from the context to help identify tlie word mean- 
ing, yet inuny subtests deal with isolated words. 

(e) Compralwnslon questions ihat can ha treated like nonsenso. 
Many t[ueslions are stated in mah a way that readers nuiy 
answer the in by traiisfonning the question to a statcnient and 
searching the text for a match without necessarily understand- 
ing. Tliey mam'puhite tlie sentence patterns as if Uiey were non- 
sense like tlie jabherwock. Q^Wluit did tlie momeraths do? 
A — ^The momeraths outgrabe. 

Abuses of Tests 

There ure iiscs of tests which clearly violate the publish er'jj 
udviee on liniitations in their use. 

One commonj recent abuse is giving tests at too frequent 
intervals. Many rcquirenicnts for reporting progress in reading 
as often ns unco a month are built into contracts for rcseareh or 
deinonstration projects. In the nanie of accountability, tests are 
being used to measure small uicrements of progress which they 
are simply not designed to luindle. Factors such ns regression 
toward tbu^menn (a tendency for high and low scores to move 
toward the mean on repeated testing) become very important. 
Immediate, often temporary, results become more highly valued 
than long-terni, permanently held gains. 

If jobs, funding, and professional .status and pay are made 
contingent on pupil peiformance on reading tests, then the tend- 
ency to tcacli to tho test and to build curricula around the test 
will become a major trend. Instead of the cinTicular goals being 
centered aroiuid cfFective readings the gohls become performance 
on specific tests. Instead of tests functioning as a measure of 
aeh.ievement, tliey are turned into ends in themseh'es. Even if 
they had a sound theoretical base, that would be unfortunate. In 
their current state, it could be tragic, It could lead to a new kind 
of widespread functional illiteracy. 



Anotlior abuse of tests wliicli we have toiiclied on earlier 
Is the use of test scores sN^ithout close examination of each pupirs 
test perfornianco. It is not cnougli to say Mary Lope>^ is reading 
on the 2.2 leveh Ilcr responses to subtests and items nnist Iju 
examined closely so that her strengths and weaknesses are re- 
vealed. Standardi^sed reading teste are given wholesale to masses 
.. of students. But their results must bo inteipreted for catii learnt'r 
if they arc to be useful in improving that ehilds reading. Every 
child lias a right to be treated as an individual and not as a test 
statistic. 

A rehited probleni is the use of tests as exelnsivG means of 
e>'aliiating pupils' reading efTeetiveness, ignoring more extensive 
evidence of competence because it is less easily quantiflablc. 
Teachers will frequcndy tii^at a low scorer on a standardized test 
as a poor reader, Qvcn though they observe him functioning as an 
adequate reader every day In class. Tlie quantifiable performance 
on tests is so intimiclating to the teacher that he will not tmst 
his own professional judgment 

Often the pupils perform poorly on the test because it is 
irrelevant to them and penalizes them for linguistic, experientiah 
and cultural difFcrcnccs (not deficiencies). Instead of rejecting 
the test as irrelevant, wholly or partly, teachers and administrii- 
toi's accept the test and niisjudge the achievement, strengths and 
wcuiknesses of the pupils. Programs are then planned to rcniGdiate 
deficiencies that never really existed/ 

Odier abuses of reading tests occur in c^•ahlating new 
methods and fnstmctional materials. Frequently, Htde considera- 
tion fs given to tbc basic soundness of the niethod or the niaterials 
or the principles on which the tests arc based. Rather thev avo 
judged largely by how well pupils do on prc^ and posttesU, While 
effective instrnetion must ulthnately be judged by the leaming 
it produces, progress in improving instruction cannot eonio by 
using a trial-and-crror technique for cvaluntion. Not all programs 
are worth trying, nor can the test results be usefully inteipreted 
if the instructional program is not thoroughly analyzed. 

If instructional methods and materials are built around tests, 
it is likely that pupils will improve their performance on iho 
tests. The most extreme version of this is to use the test items as 
the instructional program, asking tlie pupils to respond o\^cr and 
()%'er until they produce right answers all or almost all the time. 
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This aljility to do well on the test is then assunied to prove learn- 
ing litis tnken place' liccaiiHe tlio leurnor now ciin produce a test 
score chiiractcristic of a proficient reader. Parformimce is asHumcd 
to reflect the readers coiiipetcnce exactly, no matter how it in 
produced. 

What is lint understood is that all behavior k the cud pradiict 
of a procoss and that cornpetcnce is not behavior, hut control 
os^er the process, Beha^ior, in the fonn of test perfonnancej can 
be used to infer wlnit competence exists in readings but this re- 
quires an intciprctation of the behavior based on niidcrutunding 
how reading works. 

Deciding^ on the basis of uncxLimiiied rcading=test scores, 
such vital aspects of tlie childs future as the class, group, or track 
to which he will ho assigned is a terrible abuse of reading tests* 
Tt jeopardizes the pupirs ftiCnrc and does not even offer a basis 
ftir iniproving his reading proflciency, since pupils who arc very 
diflcrent in reading nniy achieve similar scores, 

Reading Theory: Key Questions Test-Makers Must Ask 

The earlier parts of this paper have portrayed reading tests 
us rather primitive, eclectic, and atlieoretical in all aspects except 
for their use of sophisticated test dieoiy. 

The questions reading test-niakers rnust deal with to produce 
better and more useful tests arc clear; however^ there is no agree- 
inent yet on tlie answers. 

Major questions that niust be answered in building better 
tests arc (1) what is roadingi (2) what are the essential skills 
and strategies that a successfu! reader must possess; and (3) 
what arc the purposes and uses of reading? These will be con- 
sidered in order, 

What is Reading? 

Elsewhere the author has stated thLit "Reading is a compleK 
process hy which a reader reconstructs, to some degree^ a message 
encoded by a writer in graphic language," ^ 

^ Kenneth S. Coodnian and Olive S. NiloSj Hvading Frocam and Prograni 
(Urbana, 111.? Nationiil Council of Teachers of English, 1070), p, 5. 
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Wlu^tlicr one acceptn thi^^ definitions which carries with it 
the concept that reading nniHt resnlt in meaning to he conHidcred 
reading, or .^onie other definition, one nnist still Inise te.^t canstnic- 
Uaii on some coherent definition, 

Tho following groiip of rehited cjuestionH rniist also bo 
answered: 

(1) Can rending skill (fur examplOj maLching letters to .sound.s) 
he sepurated from the quest for men.ning in tcn.elnng or testing? 
(3) At what point can reading m a process he separated frorn 
it*^ uses? 

(3) Does the readiiig process ncccssiirily involve oral langimgo 
at allj or is it entirely a matter of deriving meaning froni written 
language? 

(4) Is the reading process different nt varions stages of clevelop- 
rnentj or is it the samCj varying mainly on tho effectivenes'N of 
the rRaderP 

(5) is reading a general ahility, or is it one whicli varies with 
content, interest, or task withiii each, rcudor depending on his 
G\Mi background? 

(6) Is the reading process the same or different aeross people, 
languages, cultMres, or orthogrnphios? 

Though there are implicit answers to these qucstionH in many 
current reading tests^ it appears that the test-makers havo nmde 
assumptions often without considering the issues involved, 

What AvG the EssGntial SMh and Strategiaa tJmt Effective 
Readers PossesB? 

Reading tests have generally timploycd subtests to get at 
what arc assumed to be essential reading: skills and to monitor 
. their devclopnient. To justify such practice, the followuig ques- 
tions must be answered i 

(1) Can essential skills or strategies be isolated for testing widi- 
out changing their relative values^ their basic uses, or the road- 
ing tasks in which they occur? 

(2) Are such strategies or skills universal across people^ con- 
texts, pui'poses, languages, and orthographies? 

(3) Is there an essential sequence in learning to read; i.©., must 
some skills or strategies he learned before others? 

(4) Haw are reading skills or strategies to be understood in 
terms of how language works and is used? 
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What Are tlw Furposes of Reading? 

Language, including rending, ih always a means nnd never 
an end in itself. Tin's is true \v1ietlier one is talking about tlic 
proficient user or one just learning. Meanings either its expression 
or eomprcliension^ is always tlic end for which language is* the 
meaiis. 

Ultimately then, any reiuling test must measure the sueccss 
of the reader in comprehending written language. It is nieaning- 
less to consider performance on skills tests a measure of reading 
aehievcment What counts at all stages of development is what 
the reader understands as a result of reading. 

Test-makers must be concerned with the following ques- 
tions : 

(1) Wh.ut is conipreliensitMi; how docs it work, how is it 
nchicvcdj how varied is it? 

(2) What difrerent problems face the render who is reading 
to acquire knowledge, as conipared to one who is reading for a 
mess age ulrnady within his conceptuul grasp? 

(3) What role docs the readers background and iiiterest play 
in siiceDSsful reading? 

(4) How docs critical reading differ from other reading? 

Future Reriding Tests 

Diagnostic reading tests hi the fuU.u e will need to focus on 
reading as it really occurs in natural language. This suggests the 
type of task now found in informal reading inventories. But iho 
diagnostic test of the future will be designed so that the strengths 
as well as the weaknesses of learners will be nmde clear. A shift 
will need to be niade away from counting errors to analysis of 
performance, to get at the underlying conipetonccL 

Achievement tests will need to deal with comprehension in 
a range of reading sitiuitions. They will need to avoid irrelevance. 
And they will nvci] to get at the readers ability to use written 
language eireetively, r'roup tests inay w^ell disappear, They 
sacrifice too much fv ll e sake of economy of time. 
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Stillj howeverj the inain linprovonicnt nt'oclecl in tho arua of 
testing is in use. Nd test, however cle%xnly it is constructed, can 
substitute for the insights professional teucliers get from working 
elosely with children. 
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Reactions' to the purfurniancc contract niadu betwcuii the 
Texarkana ^uhual.s and the Dor.sott Ediieational SyHtQni.s in 1969 
varied nationally froni charges that sucli contracts would de= 
hunianize ediication to counterchaigc^ that uducatioii waH too iin= 
portant to be left to educators. Whereas ^^ehool contraets routinely 
provide for services and equipnicnts easily auditahlej the Texar- 
kaiia-Dorsett eontract called for the delivery of inereascd pei'= 
formance on tliu liart of school children. The Texarkana-Dorsett 
product was to be a group of better readers^ a matter far more 
difficult to audit. 

Tliis first performance contract seerned to threaten the do= 
main previously reserved exclusively for classroom teaclicrs. Tra- 
ditionally, the teacher has been considered to be the one most 
knowledgeable about what the child needs. It is unfortunate that 
all too many teachers are willing to accept a large number of 
failures as a normal consefjuence of w^cH-conducted classroum 
procedure. School board momljersj on the other handj have be- 
come "less confident that teachers are dcdieuted to teaching stu- 
dents . . . increasingly aware that tlicy, perhaps even more than 
any other group in public education, are being held accountable 
for what transpires in schools," ^ School superintendents in major 

- "School Board MuinlJei'H View Pcrfoniiunce Ccjnhactingj" Afizonu 
Tmchar (Jnmmry mi), 18. 

m 
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vitiQH, Hiich HH Noluii Estcs of Dalhis, have bogun stating that 
Huhcjols tue going tu liave to delher one year of educational 
gi'osvth fur onu ycuir of instruction, no nnittcr what it tukui^,^ 
Fonner CoinniiHsiouci: of Ediiuatton Jamos Allen involved thu 
loderal govcnnncnt in anotht^r liunnui right: the right of cvct)^ 
child to luarn tu ruud to tlio full extent of his potential. Mount- 
ing nuud, incruuKed public concern, conceded failure of the 
present system tu produce desired renult^i—all nmda a new ap- 
proauli iniperutise, and perfornuuice eontiacting entered the 
educational scene. 

CriticH of tlie initial Texarkana Projegt felt vindicated when 
rcHultH of the 1069^70 contract were announced. Though the 
8105,000 paid to the Dorj^ett Corporation produced jionic re^ulti^, 
iheNe were declared by inany to be invalid. Dr, Robert Kraner 
ut the EVIC Evahiution CJenter, Tucson, the flnul evaluutorj ''can- 
eluded In Us final report that 30 to 100 per cent of questions 
in the tcHtH administered, to Texarkana studuntH in Maj*, 1970, 
were contaminated/ jnoaning that they had been taught'in the 
clus^rooni prior to testing. Said Kranen *Tho teachJng of te^t 
IteniH, or closely related test itenis, has invalidated the test renults 
lo the extent they cannot bo used as a \'a!id measure of achieve- 
nient* Loyd Dorj^ctt replied that only 'a s^inall amouiU of hnproper 
teaching went on, which meant tliat only 7 per cent of the te^t 
ciue^tionH could be eon^idered invalid."'^ 

Such criticljini did not ^hake Texurkana^^^ faith in tlie principle 
of perfornmnce contracting. DorHctt bid for a second year's con» 
tract and was refusud, ''There? are rumors floating that TeNarkana 
niay go to court to recover $110,000 already paid to Dorsett/' * A 
contract was awarded, howe\'er, for the 1070-71 school term by 
lexurkana to Educational Development I.tdioratorieH, Inc, 

Very siniply Htuted, a ^ghoorcon tracts with Industry to as- 
Hunig responsibility for instriiclion in a given areaj and industry 
gniu^antoes increased perfonnance on the part of llie students 
involved, Payment to the contractor depends largely on the 

-TrlpM Cmirerengo Ilukl tit SuiiiluniNturn Slate Colloj^cs Diimiit, 
Oklulujinni Suptynilior 1070* 

*^ Htimonu NVeykH, '^PijrhirninntH Ctintniutingi l^ltfull or Piinact^iip" Arlmm 
Tmchcr (Jmuuiry 107] ), J8, 
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ainount of success he hm, as revualed by objeeiive measuremDnt 
of stiiclent performance. Contract putterns vary from the estab- 
lishment of special learning centers conducted by employeus of 
the contracting firm to the iitiIlsi:ation of regular staffs and faciliticJs 
Luider the direction of contracted managers, All kind^ of fundH— 
local, Htatu, and federal — are being used to pay for the contracts. 
All existing contracts provide for a turnkuy operuliun at the end 
of one or tNVO years usually, Performance eontractSj tlien^ are used 
to get new means of guaranteeing educational success into tluj 
political system* 

Undeterred by the questionable results in Texnrkaiia, a signif- 
icant number of schools all over the country oiitered into per- 
forniancc contracting for the 1070-71 school year/ A list of the 
schools^ contractorsj and programs is given below, Of interest 
to reading specialists is the significant fact that every program 
on the list has a reading component It would seem irnperativej 
then J til at reading teachers bo well aware of tlie nature of per- 
formance contracting. 

Far from the simple contract for sei'vices or products which 
Miost attorneys can execute for school districts^ performance con- 
tracts arc exceedingly complex. Several management firms are 
n.ow engaged In the preparation of contracts and the supervision 
of the Job to be done, Juek Stenner, director of the Management 
Support Services, listed the ads^antages of pcrforniance contract- 
ing as follows: 

1. It facilitates the targeting and evaluation of educatfonal pro- 
grams, ... It ibsterH tlie ebjoutive evaluatic3n of cducalional 
results aiid alao the managerial processes by which these 
results were achieved, 

2. Performance coniracting for inslruelional stTvlce could in- 
troduce greater resources and variability into tlio public 
school sector. 

3. The pDrformance contract approach allows a school system 
to experiment in a responsible manner with low costs and 
low political and social risks. 

4. The right of every child to read at his grade level will un- 
doubtedly place great ])urdens upon the soliook* limited re- 
sources, if the Nation's schools are to make this principle a 
real ity^ they might want to eonsider nsing performance con- 
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tracting for the developnient and validation of new readmg 
progrnms, 

Through the me of the perforniance contract approachj many 
of the previously segregated children will have their academie 
duflQiencies removed on a guuranleed achievement basis 
while they are attending the newly-integnitud sehooLs. 
fi. The appronch creates dynamic: tension and responsiljle ijiHti- 
tntional change within th^ public school system through com- 
petition. Boards of education can flnLilly establish poHey and 
choose umong alternative instructional programs.*^ 

Whether the charges that performance contracthig will de- 
humanize education and is an actual threat to classroom teachers 
are valid or jiot is undecided. Certain disadvantages, however, do 
Hcem to be apparent. There is the ever-present danger that in 
some way teachers or eontrnctors will find a way to teaeh to the 
test Since Texarkana, most contracts include the services of an 
independent evaUmtor and contain intricate provisions to assure 
that the nature of the test to be gis^en remains unknown to the 
contractor and the Instructional staff until it is administered, 
Dallas, for instance, has awarded its uvaluation contract to Educa- 
tional Testing Service, but plans to bring in two additional evalua- 
tors to check the validity of the results,"' 

Another disadvantage, as yet unresolved, is the matter of 
who holds eopyrlghts on materials produced or reports published 
about the project, 

A third disadvantage, prolKibly not as critical as the others, 
is the matter of responsibility. To whom do citizens complain in 
the event of pmblems or dissatisfaction? It would seem diat the 
eliief schools ofHcer of the contracting school would still bear the 
responiibility, but It is logical to assume that contracted arrange- 
ments would allow for a shift in respDnsibility, 

Fourth^ without guidance from n profession of reading spe- 
cialists, it is possible that a school and a contracting firm may 
arrive at souie unsound behavioral objectives, and though the 
obJectiN'cs stated in the contract are met, the end results may be 
disappointing if not disastrous. 



^Jaek Steiinen ^Terfonnance Cgntrnutlnu for Instruction" ( tiniiiibliKlird 
mamiHerlpt, 1971 )» 
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Fiftli, tlio charge lias frequently buon mude that purformanco 
contracting i** yet miother way of lining industry s pockets with 
rnGncy at the expense of ,sclioolSj tcMichcrs, and cl/ildren. 

Sixth, there is the possiblhty that Robert Stake and James 
Wurdrop are correct in fcoling that progresi^ made nmy not bo 
entirely due to the efrort^ of the contracting flrnu 

Suppose thuL three students wero to be tested with a purallul 
form immediately after the pretest. The ehanees are better tlum 
50:50 that at least one of tjic thiTO would have gained a year 
or more and appear ready to graduate from the program, 
Suppo.se that 100 students vvero adniitted to conirnct instruetioii 
and pretested. After a period of tline involving no training, thqy 
were tested again and the students "gaining" u yuar were grad- 
uated. After anotlier period of tlnie witliout training, anotlier test 
and another graduation ogeur. After the fourth sueli ^Herminar 
ie^ting=even ihouyh no instruction had oceurred— the eliances 
are l)etter than SOiSO thnt two-thirds of the students would have 
graduated^ 

Finally, standardisced testing used in niany of the contract- 
ing situations "does not have the necessary content validity for 
individual student ns^essnient For years test authors and test 
publishers liave cautioned users against using these tests as diag-^ 
iiostic instrunients., Pcrforninnce-contract criterion tests should^ 
in efFect, bo diagnostic tests," ^ 

Literature concerning perfonnance contracting makes a 
number of reconnnendations to schools who intend to enter Into 
such a prograni. Because of the complexity and the newness of 
such programs, it i^ rcconnnended that scliools should employ 
tlie sorvices of management consultants in both the preparation 
of the contract and the conduct of the program. Also becaiise 
of the novelty of the Idea^ schools are cautioned to regulate the 
flow of visitors to the project; in many instances, numbers of 
interested onlookers have seriously limited the success of the 
program. 

It is further reconnnendod that the feacher s role in the pro- 
grani should 1)0 clearly defined before instruction begins. 

^ Robert E, Stake and Jniiies L, Wartlrop, ''Gain Senro Emm' in 
fDrmance Cuntmcting'* ( uupubliHlitHl niaiiuHoriiifc)* 
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If, in a tcaeliors judgment, otlier inaterials and activilics aro 
dict'itedi and tho teacher can support tlio positionj tlie ngrccnient 
of tliQ project director and the contoiotor is negotin.blo, No 
teacher has thu right, howcvcTj to unilaterally intcrveno with 
alien procedures and revise a syiStem which is legally agreed to 
and by which a contractor will receive reimbursement. Since, in 
most cases, tho teachers ihvolvcd in this kind of operation will 
ha volunteers^ making thi^ known initially, as a condition of par- 
ticipution, should reciuiro no inoro than a signed agroamGut by 
each teacher a.sHenting to this requirement of the contract " *~ 

The literaturo suggeits that the school and contractor woulcl 
do well to involve as large a segment of the community as pOHsiblD 
in the project. Not only will such involvanient provide much- 
needed public support, it will be invaluable when the project is 
turned o\^er to the school diHtiMcfc to run. 

Finally^ the school should engineer lower cost factors by 
providing a number of students whieli would make for the most 
economical situation. It is^ further, uneconomical for a school to 
purchase any non consumable materials during the first year of 
operation; such materials should be pro^'ided by the contracting 
flrin or leased. 

A nnniber of legal considerations enter into any program of 
performance contracting. Not the IciiHt of these is the relationship 
of the contract to local and stato education agencies. Before tho 
contract in. Dalhis could bo apprDVcd by tlie Texas Education 
Agency^ for instances a ruling by the state Attorney General had 
to be niadc, Tlie ruling was tliat contracts could be made and 
paid for with state and federal funds; however^ all members of 
tho contract instnictional staff had to be certifled teachers in 
the State of TexaSj the program had to runie under the regula- 
tions of the Minimum Foundation Program and wms subject to 
Agency accreditation filings, It is obvious that contracts will 
dilTer widely around the oountiy because of varying opinions 
about their legality. 

The management consultant. Jack Stennerj posed the follow- 
ing legal questions as pertinent to the preparation of tlie Dallas 
contracts: 



"All)ort V. MaydiofGrj "Factor.^ In Cnn*?idc?r In PrnpiuM'ng Pt*iTni'inanco 
ContrnctH for Injitructionj'' Educatioml Tcchnohgi/ (Jnniiary 1971), dS. 
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1. If m outside cDntrat'tur is utilized by the school district ht 
the proviHion of instruction and/or services for pupils, will 
the school districts stntutory obligutiou for ?inid instruction 
nnd services be fully mot? 

2. Are there ^itatG or federul limitations regard lug the use of 
State, Local, mid Federal funds to support iill or part of a 
perfornianco contracting project? 

3. Do existing state plans for various federal programs, that 
may be potential funding sources for the projectj permit 
utilisation of outside contractors who will pro%^idc all or part 
of the iiistruction and/or services included iii tlie project? 

4. WiW the State Education Agency authorize credit fur instnie- 
tion provided by the contractor in reading or niuthematics? 

5* Will the State Education Agency permit para pro f ess ional 
stafF hiemberH cniployed by the con tf actor to perform cer- 
tain teaching tasks under the direct supervisitjn of a ccr- 
tifled teacher? 

6. Will the State Education Agency permit the tcnchor in the 
contractors program to be the contractors employed 

7, Will an outside contrnctor.s instnictioiuil personnel stand in 
loco pormfis to the student? 

Are tlie contractor employed teachers reqiu'red to be cor- 
tiHed? 

0, Docs a local district have autliority to contract with or enter 
into agreements with an agency of the federnl guvernniont? 

10. Docs a local district have authority to contract with or to 
enter into agreement with private concerns for the provision 
of instruction? 

11. Does a local district have authority to expend local main- 
tenance funds to puy for part or all of the cost of ins true- . 
tion provided by a private concern Imdcr contriict with the 
district? 10 

\ Three types of negotiatioiis are available to schools in the 
preparation of porformance contracts. First, the school may decide 
on one single source of material and method, The advantage of 
being able to negotiutc rapidly with a single company may be 
ofFsct by the disadvantage of limiting the scope of the project to 
what that pnrtieular company can do, A second type of negotia- 



'^Jnck Stenncr, ''Ecluciitlon Pcrformnjice Contracting" (unpublished 
manuscript, Jnntmry 1970), 
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tion i§ referrucl to m ilm modified solo^sourcc method; two or 
more conipaiiics arc nskcd to subniit bidSj and one of tlie group 
is chosen^ or several arc nskcd to work in concert with each other. 
The third type^ the competitive sj^Htcm, requires far more time 
and is compHcBtcds but it does insure tht- Kchnol tho opportuiiity 
of investigating many sources of lielp and choosing tho best alter- 
native. In such a system, criteria for the program would be 
dncidcd upon and published by the schools. Bids would then be 
taken from any number of competitive cornpanicH. Such competi- 
tion is likely to produce some economy in the program also. 

Needs and BecommcndaHons 

Beeausc "of the importunce and frequency of reading pro- 
grams in performance contracting^ the following needs and recom- 
mendations have been formulated to provide gehools some 
giiidancG in their choice of programs. 

A list of sound pcrformanee objectives related to reading 
should be prepared, There is no indication, in the literature tliat 
any professional reading group has done this, There Is great need 
for the development of objectives that arc educationally sound 
and encompass the issues in the teaching of reading. I have read 
far too many proposals of reading programs which miss the mark 
to want to leave this to chance^ Perhaps a list of alternative objec- 
ti^'es from which sehools could select those most appropriate to 
their situation would be helpfuL 

Though tlie literature suggests tliat various methods and 
materials niay be used in concert with each other, I saw no indica- 
tion that this practice was used widely. I think we rnust concede 
that no one reading program, however good, is effective with all 
ehildren in a given school Varying modalities of learning, lin- 
guistic and experiential resources, means of perception, and in- 
dividual approaches to learning provide a lieterogeneity which 
makes a combination of systems preferable to one, There is sub- 
stantial need for the identiflcation of matcrialh' which would 
demonstrate to schools and teachers, long accustornod to teaching 
with one textbook and one method^ the value of worWng with 
.combinations of sy,^ terns. 
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Criteria for critiqueing reading systems and materials would 
be partlcukrly useful to school dish'iats. Special attention should 
1)0 givaa to soundness of programs from u linguistic point of view. 
None of the contracts which I read indicated that the school 
involved was even slightly aware that linguistic variety is a fact 
of life and has tremendous iinplieation for tlie teaching of read- 
ing. In as much as signiflcant work has been completed in the 
field of dialect and langiiagG differences, this information is erit^ 
ical^ to the teaching of reading^ and such understandings should 
he Incoiporatcd into guidelines for performance-contmetcd cur- 
ricula* 
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Ah om examines the four prcviuuN discussions^ the dear rulu- 
tionships that exist among them are readily evident Both eosts 
In Gdiication and the apparent iinsultabillty of present educational 
proce^sses for .signiflcant ehunk^' of our population are raising ques- 
tions regarding the efiiciency and ofTuctivcness of what is being 
done under the label ' educiitlon," These eoncerns about educa- 
tion are increasing efforts to hold accountable all those who 
participate in the procc^is and product of edueation. 

Establishing perforniance objectives allows one to define the 
ta^k, to determine if the task has been completed, and to asses 
the quality of the response to the task, 

AceountabiHty for meeting spcdflc performance objectives 
logically leads to the establishment of perfonnanco criteria and 
the develapment of specific measuremont devices* 

It was inevitable that=in our free enterprise system—some- 
one in business would apply former Defense Secretary Charles 
Wilson's '^get^a^blggcr-bang^for-the-buek*' principle to education 
and move unilaterally to establish relationships with school to 
bring it off. 

The previous discussions wore developed as a result of sev- 
eral basic questions central to the topics discuHsed. In addition, 
the very treatment of the topics subsequently raised other quoK^ 
tions that the serious participant in edacation must face. Several 
of these questions follow J 

■ -45 
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1, h the accouiitahility that is beiiig urged upon un actuully too 
inipurHniuil U) ]m of heiioflt? Are wc hnlcling sxiianls respoiisi^ 
bio for thg high-fjunhty eclucution of our youth rather than 
tmcliar&r It mi, what kind of uccouiitahility m it? Can ae- 
countnhility vovKki: with personal anonyinityP 

2, Can objectives bq eMtabliHhcd thut t^iiconipasN the total cduea^ 
tfonal process and product and their ofFeet on pepph? 

3, Is there more to education thiiii perfofniance? And can thut 
added somctliing be measured? Indeed, can it be taiiglit 

4, Is edueution dehumanized=for teuchers or for students^ 
when it is .s-ystematized? 

5, Are our present means for evaluation in education eithar 
appropriate or adequate for the task, given the need to 
meuHure both the process and pfodugt of edueationP 

6, Is it possible for nonediication people to do a total job of 
ed ilea ting studentsP 

Before aecepting or rejecting any of th^^^ 
bility, behavioral objeetives, ovaliiation, perforniance contraetlng 
— ^niany muCH must be explored/ 

Ik'sponding too quickly to the apparent efBciency of per- 
formance objectives niay lead to nicchanlstie instruction. Reject- 
ing behavioral objectives in the name of affective concerns may 
mask the fact tliat In too many classrooms there is little concern 
for or clarity of objectives related to cM'ther cognith^e or affective 
aspects of cdn cation. 

Heady acceptance of the logic of accountability may allow 
intritsionH into education by groups with questionablu motives 
and dubions qnaliflcations. Hejecting the concept of accountu- 
iMlity in the nnniG of professionalism may mask inefflciencyj slop- 
pinoss, and unconcern. 

Relinnco on inappropriate instruments may damage children 
and support inappropriate teaching. Rejection of evaluation be- 
cause of the inadequacy of instnuncntatlon can mask irresponsible 
leacliing. 

In conclusion, as it considers Instruction^ th© educational 
profession lias a tendency to feol itself inadequate to oppose vic- 
timizing pressures. But, when it comes to salaiy, demands on per- 
sonal time, numbers students per class, the profession becomes 
quite niilitant Perlmps we need to examine our priorities, take 
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the good that is implicit in thu factor— accountability, l^elmvioral 
objectives, cvahmtlon, pcrforniaiicc contracting — ^ancl vlgoromly 
pursue tliat good for the sako of our students and their futures. 



